Skip to main content

Technology used

This post lists the hardware and software you will need.

Hardware​

hardware

To build the RasPiAI you will need a single board computer called a Raspberry Pi. For the LLM to run smoothly, you will need a Raspberry Pi 4 or a Raspberry Pi 5 with 8GB of RAM. The 4GB version will work, but you will notice a dramatic difference in speed. A micro-SD card with a high transfer rate is also recommended.

Software​

software

In order to get the different LLMs up and running we are using Ollama and as a user interface we are using Open WebUI.